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Description 

[Method and Apparatus for the 
Suppression of Pinning in Stereoscopic 

Display Systems] 

Background of Invention 
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Summary of Invention 

[0005] The present invention relates to the augmentation of 

stereoscopic display systems to suppress undesired visual 
artifacts. 

[0006] stereoscopic image display systems rely on the presenta- 
tion of slightly different views of a scene to each eye of 
the viewer. Objects within these separate images are lat- 
erally displaced such that each eye sees the same object 



at somewhat different locations. The discrepancy between 
perceived location creates a condition known as retinal 
disparity. The human visual system infers depth by means 
of this discrepancy and if all such objects within the field 
of view exhibit consistent stereoscopic clues, the observer 
perceives a sense of depth and thus a stereoscopic illu- 
sion. A variety of stereoscopic display systems have been 
described in the patent literature. 

[0007] The human visual system relies on a variety of visual clues 
as it determines depth from the visual images it sees. 
Depth can be perceived by means of relative motion, rela- 
tive size, increased detail in objects closer to the viewer, 
etc. It is well known that some depth clues are more pow- 
erful than others. For example, persons with monocular 
vision can still perceived depth by means of relative mo- 
tion and by means of observing some objects to obscure 
others in the field of view. Those objects that obscure 
others are interpreted as being closer than those objects 
they obscure, for example. 

[0008] Human vision relies on a complex and little understood 
process commonly known as "scene interpretation" as it 
brings order to visual perception. Such processes include 
segmentation, color perception, edge detection, etc. If a 



viewer is presented with conflicting visual clues the nor- 
mal human response is to restart the process of "scene 
interpretation" to determine if a more plausible interpre- 
tation of the visual field can be made. 

[0009] Consistency of visual clues is extremely important in the 
creation of stereoscopic imaging. If conflicts occur the 
sensation of depth is lost and the viewer perceives double 
vision. The stereoscopically encoded objects are no longer 
fused and interpreted to appear at various points in space, 
but are seen as two distinct views that is confusing and 
uncomfortable for the viewer. 

[0010] The movement of stereoscopic objects off of the stereo- 
scopic display causes a common problem encountered in 
stereoscopic images. Objects perceived to be floating in 
front of the display begin to disappear "behind" the mar- 
gin of the display device. These objects are occluded by 
an visual percept that has previously been interpreted as 
behind the stereoscopic object. Occlusion is a more pow- 
erful stereoscopic visual clue than is retinal disparity. 
When these objects move off screen a conflict in visual 
clues is perceived causing a loss of the illusion of stereo- 
scopic depth. This condition is commonly referred to as 
stereoscopic "pinning". 



[0011] Pinning can be controlled when creating stereoscopic 
movies by insuring that objects perceived as in front of 
the surface of the display (which is known as the zero 
parallax plane) are never moved off screen until they have 
receded to a position that is interpreted as behind the 
edge of the screen. Since the movie is carefully shot, pin- 
ning can be avoided by careful attention to the placement 
and movement of actors and objects within the scene. 

[0012] Accordingly, several objects and advantages of this inven- 
tion over existing methods and the teaching of the prior 
art include the object to provide means for suppressing 
"pinning" during the presentation of stereoscopic images, 
videos, motion pictures and computer generated and or 

presented stereoscopic material. 
Brief Description of Drawings 

[0013] Figure 1 depicts the spectral sensitivities of the three 

color sensing cones in the retinal mosaic. These are com- 
monly termed Short, Medium and Long Wavelength Sensor 
and are abbreviated as SWS, MWS and LWS. Label 102 de- 
picts the Long wavelength cone sensitivity curve. Label 
104 designates the Medium wavelength cone sensitivity 
curve. Label 106 designates the Short wavelength cone 
sensitivity curve. Each cone sensor type can received a 



broad spectrum of light. Color is derived by comparing 
the signaling strength from neighboring cones. The 
Medium and Long Wavelength cone sensitivities overlap 
broadly whereas the Short Wavelength Sensor type cone 
has a narrow spectral range that does not broadly overlap 
the sensitivities of the MWS and LWS cones. As depicted in 
Figure 1, light whose frequency is at or near 450 nanome- 
ters is primarily sensed by the SWS cones. 

[0014] Figure 2 depicts the relative distribution of short, medium 
and long wavelength sensing cones. The figure consists of 
two micrographs of the same region of the retinal mosaic. 
The, labeled 202 includes the macular pigment. The sec- 
ond, labeled 204 depicts the same region without the 
macular pigment. The cones are more clearly seen in the 
region labeled 204. The Long wavelength cones are de- 
picted by label 206. Label 208 depicts the Medium wave- 
length cones whereas label 210 designates the Short 
wavelength cones. There are approximately sixteen times 
more medium and long wavelength cones than short 
wavelength cones as is indicated in this micrograph. 

[0015] Figure 3 depicts the central region of the fovea: the region 
of highest visual acuity. The area designed as 302 depicts 
the fovea region whereas label 304 indicates the central 



fovea. In this region of the retina the cone cells are 
smaller and more tightly packed than in the periphery of 
the retina. Moreover there are no short wavelength sen- 
sors in the central fovea. 
[0016] Figure 4 shows a stylized representation of the apparatus 
described in this patent. Element 402 is the stereoscopic 
display device including border element 404 and display 
element 406. The viewer's right and left eyes are depicted 
as elements 408 and 410, respectively. The anti-pinning 
border is defined by the region bounded by elements 412 

and 414. 
Detailed Description 

[0017] Although the following detailed description contains many 
specifics for the purposes of illustration, anyone of ordi- 
nary skill in the art will appreciate that many variations 
and alterations to the following details are within the 
scope of the invention. Accordingly, the following pre- 
ferred embodiment of the invention is set forth without 
any loss of generality to, and without imposing limitations 
upon, the claimed invention. 

[0018] The present invention accordingly has an objective to pro- 
vide a variety of novel means for the creation of apparatus 
for presentation of stereoscopic material. 



[0019] a preferred embodiment of this invention employs a 

perimeter around the displayed stereoscopic image that 
serves to provide ambiguous depth clues. Such ambiguity 
reduces or eliminates a well known stereoscopic artifact 
that has limited the use of stereoscopic imaging. This ar- 
tifact is known in the art as "pinning". It occurs whenever 
a stereoscopic object is perceived to be positioned as if 
floating in front of the display surface. If that object is 
translated so that it either touches or begins to move off 
the edge of the display, the visual system observes two 
conflicting visual clues: an object interpreted as being in 
front of the display is occluded by the edge of the display 
(which is perceived as behind the object). Since occlusion 
is a more powerful visual depth clue than is retinal dispar- 
ity, the illusion of depth is destroyed and the viewer no 
longer perceives a stereoscopic image. 

[0020] The problem of pinning occurs in all real time stereo- 
scopic imaging systems. Those skilled in the art of creat- 
ing stereoscopic content knowingly create content such 
that forward objects never intersect the edge of the dis- 
play so as to prevent pinning from occurring. 

[0021] The apparatus described in this invention and shown in 
Figure 4 employs a luminous blue border along the pe- 



riphery of the displayed image. The use of blue light is in- 
tentional because of a variety of factors related to the hu- 
man visual system. 
[0022] it j S we || known to those skilled in human vision that the 
lens of the human eye is a simple lens that is achromatic. 
That is, the lens focuses light of different wavelengths 
(colors) at various position in space. Light of deep blue 
color is always focused at a point that is substantially in 
front of the retina and is thus always perceived as out of 
focus. Moreover, blue light is primarily sensed by one of 
three color receptor cells of the retina which are called 
SWS (Short Wavelength Sensor) cones. The region of the 
human retina which has the highest spatial acuity is lo- 
cated in a region known as the fovea region of the retina. 
It is well known that SWS cones are not present in the 
central region of the fovea. SWS cones begin to occur in 
the peripheral region of the fovea and are significantly 
less numerous, as is shown in Figure 2, than the other two 
types of color receptive cells (the MWS and LWS cones). 
Various studies report that there are as few as one six- 
teenth as many SWS cones in the retina as other color 
sensors. The perception of blue light and in particular the 
use of a luminous blue border around the stereoscopic 



image provides ambiguous visual depth clues that inhibit 
and reduce the problem of pinning. Ideally, the luminous 
blue border should generate light that is only perceived by 
the SWS cone sensors (a wavelength of approximately 450 
nanometers or shorter). 

[0023] The illusion of depth created by stereoscopic imaging is 
dependent on presenting slightly different images to each 
eye. Elements within each image are displaced laterally in 
a manner that is proportional to their perceived distance 
to the viewer. It is clear that the border of the stereo- 
scopic displayed image can become a factor that can in- 
hibit the perception of depth even though consistent 
stereoscopic cues (retinal disparity) are provided through- 
out the displayed image. 

[0024] Moreover, the luminous deep blue border along the edge 
of the display surface can be constructed so that the edge 
of the displayed image merges into the bordering region 
such that the intensity of the edge of the displayed image 
is subtly merged to deep blue, thus decreasing the dis- 
continuity between the border of the displayed stereo- 
scopic image and the image itself. 

[0025] The apparatus now disclosed and described can be further 
augmented to enhance the stereoscopic viewing experi- 



ence by employing a luminous blue perimeter bounding 
the edge of the stereoscopic display area as shown in Fig- 
ure 4. 

[0026] it is well known within the art that the human visual sys- 
tem employs a variety of visual data in order to perceive a 
sense of depth. These include relative size, relative mo- 
tion, retinal disparity and object occlusion. Object occlu- 
sion is a more powerful visual clue than is retinal dispar- 
ity. 

[0027] | t a | so we || known that stereoscopic objects made to ap- 
pear as if in front of the display surface can cause a con- 
flict in visual clues if said object(s) move to or off the field 
of view. The object appears to have disappeared behind 
the edge of the display and thus be occluded by an object 
that was initially perceived as behind said object. When 
this occurs the perception of depth is lost. The two dis- 
played images are no longer merged so as to perceive 
depth but now appear as two slightly displayed images. 
The illusion of depth is lost. "Pinning" is a term that is 
used to refer to the creation of this condition in stereo- 
scopic display systems. 

[0028] it has been discovered that "pinning" can be suppressed 
and/or eliminated by means of providing a luminous deep 



blue border around the periphery of the stereoscopic dis- 
play area. 

[0029] Some aspects of human vision, although studied, are not 
well understood. But a rational argument can be made as 
to why this effect occurs. For example, the lens of the eye 
is a simple lens subject to chromatic distortion. Different 
wavelengths (colors) of light come to focus at different 
distances from the lens and the retina. Some colors (e.g. 
red) come to focus at a position that is somewhat behind 
the surface of the retina. Conversely, other colors, such as 
blue (short wavelength light) come to focus substantially 
in front of the retina. The human visual system is not ca- 
pable of focusing blue light onto the retina of the eye. 

[0030] The perception of color in the human visual system is not 
well understood. A number of retinal sensing cells (cones 
and rods) have been identified. The frequency response 
and spatial distribution of these cells has been studied in 
great detail. There are three types of cone or color sens- 
ing cells within the eye which are typically called Long 
Wavelength, Medium Wavelength and Short Wavelength 
Sensors (L, M and S cones). As shown in figure 1, the fre- 
quency response of the L and M cones is broad whereas 
the S cones have a narrow frequency response. And al- 



though there is considerable overlap in the sensitivities of 
the L and M cones there is relatively little such overlap in 
the frequency response of the S cones. 
[0031] it is well known that there are no S cones in the most sen- 
sitive region of the retina which is called the fovea. 
Whereas most regions of the retina consist of a mixture of 
rod and cone sensing cells, the fovea only contains cone 
type cells and only those which are of the L and M types. S 
type cones are only detected in the periphery of the fovea 
region and their spatial distribution is much lower than 
either the L or M cones. It is estimated that there are less 
than one sixteenth as many S cones as either L or M cones 
in the retina. 

[0032] since short wavelength sensing cells (S-cones) do not oc- 
cur in the central region of the fovea, it is well known that 
it is visually impossible to attain focus on an object emit- 
ting only shortwave length (e.g. blue only). The elements 
of the image are defocused by virtue of the achromatic 
characteristics of the lens of the eye and also by the ab- 
sence of appropriate sensor cells within the prime focus 
region of the retina. 

[0033] The combination of defocused short wavelength (blue) 

light and lack of S cones in the area of highest visual acu- 



ity results considerably lower spatial and temporal sensi- 
tivity of the human eye to blue light. Blue objects must be 
substantially larger in size to be perceived clearly by the 
eye. These factors appear to make difficult, if not impos- 
sible to derive depth information from purely blue ele- 
ments. 

[0034] a luminous blue border around a stereoscopic image cre- 
ates a zone of depth ambiguity about the location of the 
screen on which the image is displayed image. This ambi- 
guity can be employed to suppress and possibly inhibit 
stereoscopic pinning and is employed for this purpose in 
this patent. 

[0035] Figure 1 teaches that there is little overlap in spectral re- 
sponse between S- and either L- or M- cones at wave- 
length at 450 nm or less. As such, the luminous border 
described should emit light at approximately this or 
shorter wavelengths. 



